Continued utterances

Speech-to-text ends an utterance at every pause, so a user who pauses in the middle of a sentence – "Give me an appointment" … "with a plastic surgeon" – reaches the agent as two utterances. By default the agent answers each one in turn: it plays its response to the first part, perhaps "Do you mean our booking service?", and only then responds to the second.

With continued utterances enabled, when the user continues speaking before the agent started playing its response, that response is withheld – it is never played – and the agent answers both parts as one utterance: "Give me an appointment with a plastic surgeon". The withheld response is removed from the conversation history the Large Language Model sees, so it does not assume the user heard it.

Enable it by adding the continued_utterance parameter to the Advanced tab of the Agent's or Flow's dialog:

{
    "continued_utterance": {
        "mode": "enabled"
    }
}

This applies to voice calls with Agents and Flows on regular (non-speech-to-speech) models, except in Agent assist mode.

Each withheld response and each merged utterance is recorded as a continued_utterance entry in the conversation log, so the log still shows what the agent would have said.

Parameter Type Description
continued_utterance ContinuedUtterance Answer the whole utterance when the user continues speaking before hearing the response.

ContinuedUtterance

Parameter Type Description
mode enum Supported values:
• disabled – each utterance is answered in turn (default)
• enabled – a response the user has not started hearing is withheld when they continue speaking, and the whole utterance is answered

In a multi-agent topology, a sub-agent – an Agent or a Flow – without its own continued_utterance follows the root agent's.